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Description 

DIGITAL PICTURE SCALING 

Background of Invention 
[0001] 1. Field of the Invention 

[0002] jhe present invention relates to scaling digital pictures, 
and more particularly, to scaling digital pictures with re- 
duced memory usage. 

[0003] 2. Description of the Prior Art 

[0004] In practice, scaling digital pictures is usually performed 
for still images or video frames to fit a specific applica- 
tion. The conventional method to scale a picture is to 
scale its horizontal dimension (width) first and then its 
vertical dimension (height), or vice versa. This requires a 
large buffer memory to store the results of scaling the 
horizontal dimension. 

[0005] Please refer to Fig.l and Fig. 2. Fig.l is a schematic dia- 
gram ofan up-scaling process according to the prior art, 
and Fig. 2 is a schematic diagramofa down-scaling process 
according to the prior art. W and H are the old width 
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and old height; W and H are the new width and new 
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height; SRC is a memory for storing a source picture; DST 
is a memory for storing a scaled picture; and BUFFER isa 
memory for temporarily storing data during the scaling 
process. The method for performing a scaling process is 
to use the sampling formula at a new sampling point as 
Eq.l. 

[0006] x{t) = ^x{nM-n) (Eq.l) 



Where x(t) is the new pixel value at the new sampling 
point t from n=0, x(n) is the original pixel value at index 
n, and h(t-n) is the value of an interpolation function 
shifted by t from index n. Furthermore, the coefficients i 
and j give the number of original pixels involved in recon- 



structing x(t), i.e. the number of original pixels involved is 
given by (i+j+1). As a result, based on Eq.l, the scaling 
process can be realized by a filter-bank implementation. 
The number (i+j+1) gives the number of filter taps and 
h(n) is the tap weighting at n. The sampling process and 
the theory behind it are well known by those in the art, 
and accordingly it will not be discussed in detail here. 
[0007] Ideally, a large buffer memory provides the freedom for a 
scaling process to exploit filters of any length to achieve 
the required scaling quality. That is, the size of the buffer 
memory required is (W *H ) bytes. However, from Fig.l 
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and Fig. 2, the problem is when up-scaling the input pic- 
ture the memory required increases dramatically. For ex- 
ample, if a picture is to be scaled to be two times larger in 
each dimension, the buffer memory required becomes (W 
*H )=(2*W *H ). This high memory requirement is 
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not feasible in some applications. In particularly, this high 
memory requirement is not suitable for hardware imple- 
mentation by integrated circuits (ICs). 
Summary of Invention 

[0008] It js therefore a primary objective of the claimed invention 
to provide a method for scaling a digital picture with re- 
duced memory to solve the above-mentioned problem. 



[0009] According to the claimed invention, a metliod for scaling a 
digital picture comprising following steps:(a) inputting a 
source picture to a source memory; (b) providing a first 
buffer and a second buffer; (c) determining scaling fac- 
tors; (d) generating initial data in the first buffer and sec- 
ond buffer; (e) transferring a portion data of the digital 
picture from the source memory to the first buffer; (f) us- 
ing a filter to scale the data in the first buffer in a first di- 
rection and storing the scaled data in the second buffer; 
(g) using the filter to scale the data in the second buffer in 
a second direction and storing the scaled data in a desti- 
nation memory; and (h) outputting a scaled picture from 
the destination memory. 

[0010] These and other objectives of the present invention will no 
doubt become obvious to those of ordinary skill in the art 
after reading the following detailed description of the pre- 
ferred embodiment that is illustrated in the various fig- 
ures and drawings. 
Brief Description of Drawings 

[0011] Fig.l is a schematic diagram ofan up-scaling process ac- 
cording to the prior art. 

[0012] Fig. 2 is a schematic diagram ofa down-scaling process 
according to the prior art. 



[0013] Fig. 3 is a scliematic diagram ofan up-scaling process ac- 
cording to tlie present invention. 

[0014] Fig. 4 is a scliematic diagram ofa down-scaling process 
according to the present invention. 

[0015] Fig. 5 is a flowchart according to the present invention. 

[0016] Fig. 6 is a flowchart of a preferred embodiment according 

to the present invention. 
[0017] Fig. 7 is a schematic diagram of mirrored data extension. 

Detailed Description 

[0018] Please refer to Fig. 3 and Fig. 4. Fig. 3 is a schematic dia- 
gram ofan up-scaling process according to the present 
invention, and Fig. 4 is a schematic diagram of a down- 
scaling process according to the present invention.where 
SRC is a memory for storing a source picture, and DST is a 
memory for storing a scaled picture. The size of the first 
line-buffer BUFFERl is (m*W ) bytes and the size of the 
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second-buffer BUFFER2 is (n*W ) bytes, where m and n 
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are the number of lines for the first and second buffers 
and depend on the length of the filter used. That is, if the 
length of the interpolation filter is L, then m = L and n = 
(2*L-1). Furthermore, the function of the buffer BUFFERl 
is to store data needed for horizontal scaling as well as to 



store the decimated picture data. Tlie BUFFERl is not nec- 
essary if tlie source picture can be randomly accessed 
from tlie memory SRC. On the other hand, the function of 
the BUFFER2 is to store the horizontally scaled results as 
well as to organize the data for vertical scaling. 
[0019] Please refer to Fig. 5. Fig. 5 is a flowchart according to the 

present invention. In step 210, the picture to be scaled is 
inputted and stored in the memory SRC. In step 220, the 
scaling operation for the picture is determined as being 
up-scaling or down-scaling. If the picture is to be up- 
scaled, during step 221, rows of picture data are trans- 
ferred to the buffer BUFFERl. If the picture is to be down- 
scaled, during step 222, the data decimation operation is 
determined. If the decimation operation is enabled, rows 
of the picture data are decimated when necessary and 
transferred to the buffer BUFFERl. Otherwise, rows of pic- 
ture data are transferred to the buffer BUFFERl. In step 
230, the horizontal scaling process is performed and the 
results are stored in the buffer BUFFER2. In step 240, the 
vertical scaling process is performed and the results are 
outputted to the memory DST. In step 250, if the picture 
has data remaining to be scaled, repeat step 220 to step 
240 until all rows of the picture data have been horizon- 



tally and vertically scaled. Finally, the step 260 is executed 
to finish the scaling process. 
[0020] Please refer to Fig. 6. Fig. 6 is a flowchart of a preferred 
embodiment according to the present invention. For 
clearly explaining the spirit of this invention, the preferred 
embodiment of this invention exploits a 4-tap interpola- 
tion filter to perform the scaling process. Furthermore, the 
up-scaling ratio is assumed to be up to twice as large as 
the original picture in each dimension, but the down- 
scaling ratio is not limited. Therefore, the size of the 
buffer BUFFERl is 4*W bytes and the size of the buffer 
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BUFFER2 is 7*W = 14*W bytes, as W = 2*W . For 
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conveniently explaining the processing steps in the 
flowchart, the whole process can be divided into three 
groups, namely the initialization steps, horizontal scaling 
steps, and vertical scaling steps. 
[0021] In the group of initialization steps, the picture to be 

scaled is firstly inputted and stored in the memory SRC. 
After that, the scaling factors and the decimation factors 
are determined. Initially, the horizontal and vertical scal- 
ing factors are respectively given by S = W /W and S 
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= H /H , where W and H are respectively the 
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width and height of the input picture, and W and H 

new new 



are respectively the width and height to be scaled to. The 
initial horizontal scaling factor S determines whether the 
picture data will be decimated in the horizontal direction 
before being transferred to the buffer BUFFERl. That is, if 
the decimation operation is enabled and S > 2, then pic- 
ture data is decimated horizontally according to the hori- 
zontal decimation factor d = floor(log S ), where the 
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floor function truncates the decimal portions; otherwise, 
no horizontal data decimation will be performed and set d 
= 0. Similarly, the initial vertical scaling factor Sv deter- 
mines whether the picture data will be decimated in the 
vertical direction before being transferred to the buffer 
BUFFERl. That is, if the decimation is enabled andS > 2, 

V 

then picture data is decimated vertically according to the 
vertical decimation factor d = floor(log S ); otherwise, no 

V 2 V 

vertical data decimation will be performed and set d = 0. 

V 

As a result, according to the picture decimation process, 
the data in the memory BUFFERl and the memory SRC can 
be generally expressed as: 
[0022] BUFFERl(x,i) = SRC(2'^^*x,2'^''*(y+i)), 

[0023] where X ranges from 0 to (W -1), y ranges from 0 to (H 
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-1) and i ranges from 0 to 3. 

old 

[0024] Since after decimation the width and height of the input 



picture will become W = W /d and H = H /d , the 
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actual scaling factors used in the scaling process are re- 
ferred to as S = W /W and S = H /H . After deter- 
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mining the decimation and scaling factor, the initial hori- 
zontal scaling process is preformed. In this process, two 
lines of SRC data are transferred to the buffer BUFFERl, 
such as: 

[0025] BUFFERl(x,0) = SRC(2'^^*x,0), 
[0026] BUFFERl(x,l) = SRC(2'^^*x,2'^''), 

[0027] where x ranges from 0 to (W -1). 

[0028] Based on Eq.l, the initial horizontal scaling process on 
these two lines of data becomes: 



BUFFMR2{x2,5)=^BUFFERl(xl+n,0)*w(,n) . 

n--l 



and 



B UFFER 2( x2,6) = ^BUFFER l{xl + nX)* w(n) 

n-H 



where x2 ranges from 0 to (W l)and xl = floor(S *x2), 
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which neglectsfractional portions. The result of the initial 
horizontal scaling from rowO and rowl of the buffer 
BUFFERl is respectively stored in row5 and row6 of the 
buffer BUFFER2. The practical implementation of the scal- 
ing process and the method of obtaining w(n) are clear to 
those skilled in the art and will not be discussed here. 
However, one thing that should be mentioned is that the 
boundary conditions are treated as a mirror-extension 
process. 

[0029] Please refer to Fig. 7. Fig. 7 is a schematic diagram of mir- 
rored data extension. There are two options, and each op- 



tion uses one row of the buffer BUFFERl with the width of 
W as an example. 
[0030] In option 1: 

[0031] BUFFERl(-l) = BUFFERl(O), 
[0032] BUFFERl(W) = BUFFERl(W-l), and 
[0033] BUFFER1(W+1) = BUFFERl(W-2). 

[0034] In option 2: 

[0035] BUFFERl(-l) = BUFFERl(O), 
[0036] BUFFERl(W) = BUFFERl(W-l), and 
[0037] BUFFER1(W+1) = BUFFERl(W-2). 

[0038] Finally, in the last step of the initialization steps, the ver- 
tical index pointers y and y2 are both set to 0, where y is 
the vertical index counter for the memory SRC and y2 is 
the vertical index counter for the memory DST. The func- 
tions of pointers y and y2 will be clear in the following 
discussion. 

[0039] In the group of the horizontal scaling steps, the first step 

is to re-arrange the buffer BUFFER2 as follows: 
[0040] BUFFER2(x2,0) = BUFFER2(x2,5)if y = 0, 

[0041] BUFFER2(x2,0) = BUFFER2(x2,4)if y 0, 



[0042] BUFFER2(x2,l) = BUFFER2(x2,5), 
[0043] BUFFER2(x2,2) = BUFFER2(x2,6), 
[0044] BUFFER2(x2,5) = BUFFER2(x2,4)if y >(H -7), 

d 

[0045] BUFFER2(x2,6) = BUFFER2(x2,3)if Y ^(H -7), 

d 

[0046] where x2 ranges from 0 to (W -1). 
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[0047] After that, more rows of picture data are transferred from 

the SRC to the buffer BUFFERl, such as: 
[0048] BUFFERKx.O) = SRC(2'^"*x,2'^''(y+2)), 

[0049] BUFFERl(x,l) = SRC(2'^"*x,2'^\y+3)), 
[0050] and if y < (H -7), then 

d 

[0051] BUFFERl(x,2) = SRC(2'^"*x,2'^''(y+4)), 
[0052] BUFFERl(x,3) = SRC(2'^"*x,2'^''(y+5)), 
[0053] where x ranges from 0 to (W -1). 

d 

[0054] horizontal scaling process is given as follows: 



BUFFER2(x2,3)=^BUFFER^{x].+nJa)*^v(n) , 

n--l 



, and 



n— I 



;and if y < (H -7), then 
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BUFFER2ix2,5)=^BUFFERl{xl +71,2)* win) , 

n— I 



, and 



n-H 



where x2 ranges from 0 to (W -l)and xl = floor(S *x2). 
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That is, the horizontal scaling results from rowO and rowl 
of the buffer BUFFERl are saved to row3 and row4 of the 
buffer BUFFER2, respectively. Also, if y is smaller than (H - 
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7), then the scaling results from row2 and row3 of the 
buffer BUFFERl are saved to row5 and row6 of the buffer 
BUFFER2. 

[0055] In the group of vertical scaling steps, the first step is to let 
yl = floor(S *y2). After that, if yl satisfies y <yl < (y+4) 
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and y2 satisfies y2 < H , then the vertical scaling pro- 
new 

cess is performed as follows: 



where x2 ranges from 0 to (W -1). After the vertical 
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scaling process, the vertical index pointer y2 is incre- 
mented by 1, i.e. y2 = y2 + l. Finally, the process returns 
to the first step of the vertical scaling steps. On the other 
hand, if yl does not satisfy y<yl < (y+4) ory2 does not 

satisfy y2 < H , then the vertical index pointer y is in- 
new 

creased by 4, i.e. y = y+4. After that, the range of y is 
verified; if y is smaller than (H -3), then the entire scaling 

d 

process beginsagain from the first step of the horizontal 
scaling process. Otherwise, the scaling procedure has 
been accomplished and all processes are terminated. 
[0056] In contrast to the prior art, the present invention provides 



a line-buffer scaling method that enables horizontal-scal- 
ing and vertical-scaling processes to use the same num- 
ber of filter taps for achieving the best possible quality, 
while the buffer memory requirement is kept to be as 
small as possible and is proportional to the filter length. 
Therefore, this low-memory scaling method is suitable for 
the case when system memory available is constrained. 
[0057] Those skilled in the art will readily observe that numerous 

modifications and alterations of the device may be made 
while retaining the teachings of the invention. Accord- 
ingly, the above disclosure should be construed as limited 
only by the metes and bounds of the appended claims. 



